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Abstract. We present an experimental and simulated model of a multi-agent stock market driven by a dou- 
ble auction order matching mechanism. Studying the effect of cumulative information on the performance 
of traders, we find a non monotonic relationship of net returns of traders as a function of information 
levels, both in the experiments and in the simulations. Particularly, averagely informed traders perform 
worse than the non informed and only traders with high levels of information (insiders) are able to beat the 
market. The simulations and the experiments reproduce many stylized facts of tick-by-tick stock-exchange 
data, such as fast decay of autocorrelation of returns, volatility clustering and fat-tailed distribution of 
returns. These results have an important message for everyday life. They can give a possible explanation 
why, on average, professional fund managers perform worse than the market index. 

PACS. 89.65.Gh Economics; econophysics, financial markets, business and management - 89.65.-s Social 
and economic systems - 89.70.+C Information theory and communication theory - 89.75.-k Complex 
systems 

1 Introduction 

"We live in an information society" is a commonly used 
phrase today. Education, knowledge and information are 



2 Bence Toth, Enrico Scalas, Jiirgen Huber, Michael Kirchler: The value of information in a multi-agent market model 

considered to be the most important ingredients to success will see the most interesting cases lie between these ex- 

in business. While we generally agree with this notion, we tremes. The averagely informed traders are the ones we 

think that it does not always hold for financial markets, are most interested in, as they exhibit underperformance 

70 years ago Cowles [1] was the first to find that the vast in our experiments. 

majority of stock market forecasters and fund managers The paper is structured as follows: After the introduc- 
are not able to beat the market. Subsequent studies by tion, Section [5] presents the outline of our experiments, 
Jensen [2] and Malkiel [3,4] confirmed this finding. On including the settings, information setup and results. Sec- 
average about 70 percent of actively managed stock mar- tion [3] presents the simulations with subchapters for the 
ket funds are outperformed by the market, for bonds the market mechanism, the information system, and trading 
number is even higher at 90 percent. Passive investment strategies. Results from the simulations are presented in 
yields on average 1.5 percent per annum more than an Section 31 and Section [5] concludes the paper, 
actively managed fund [3j. How can we explain that the 
highly paid, professionally trained and, above all, well in- n n . ■• r w- 

6 J J 2 Outline of Experiments 

formed specialists managing these funds are not able to 

perform better than the market? The question whether The experiments we discuss here have been performed by 



more information is always good for market participants tw0 of us (Jurgen Huber and Michael Kirchler) at the 
is highly relevant not only for fund managers, investment University of Innsbruck in 2004 with the participation of 
banks and regulators, but for every individual investor as business students. To reduce statistical errors the experi- 
well. In this paper we present results from experimental ments were repeated seven times with different subjects, 
and simulation studies which allow improving our under- For more details on the experimental setup and the results 
standing of the relationship between information and in- see 

Ref. ma. 

vestment success in markets. Our model features several 

innovations: First, our model is a multi-period model and 2.1 Settings of the Experiments 

therefore dynamic. It thereby overcomes one of the ma- 
jor weaknesses of earlier research relying only on static 
environments. Second, we use several information levels 
instead of only two used in most of the literature on the 
topic (e.g. Refs. [5I6I7I8I9] ). This is critical to go beyond 
the straightforward (and not surprising) result that insid- 
ers are able to outperform uninformed investors. As we 



The experiments were based on a cumulative information 
system. Nine traders with different forecasting abilities 
were trading on a continuous double auction with limit 
orders and market orders. (Additional experiments were 
run with 20 traders distributed among five different infor- 
mation levels. The main result - a J-shaped distribution 
of returns - always emerged [11].) On the market a risky 
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asset (stock) and a risk free bond (cash) were traded. Any ture of the market where better informed agents know 

time, traders could enter a new limit order to the book future dividends earlier than less informed ones. Since the 

or accept someone's limit order (realising a market order) market trading consists of several periods (new informa- 

with all trades fixed to unit volume. Each trader had a tion entering the market in each), the design implies that 

starting endowment of 1600 units in cash and 40 shares information trickles down through the market from the 

of stock (each worth 40 units in the beginning). The ex- best informed to the broad public over time, 

periment consisted of 30 periods each lasting 100 trading The information that traders obtain is the present value of 

seconds. At the end of each period a risk free interest rate the stock conditioned on the forecasting horizon (E(V\Ij,k))- 

was paid on the cash held by the traders and dividends This is calculated using Gordon's formula, discounting the 

were paid based on the shares owned, with parameters set known dividends and assuming the last one as an infinite 

to let one period correspond to one month in real mar- stream which is also discounted. E(V\Ij^) stands for the 

ket. The dividend process (D(i)) was a random walk with conditional present value of the asset in period fc for the 

Gaussian steps: trader with information level j (Ij). 

k-\-j — 2 

D(i) = D(i 1) + 0.00047V(0, 1) (1) E<y\I iJk ) = + £ (1 f^k ■ ( 2 ) 

with -D(O) = 0.2, where N(0, 1) is a normal distribution where r e is the risk adjusted interest rate (E(- ■ • | • • •) 
with zero mean and unit variance. To achieve identical denotes the conditional average). 

conditions, the same dividend process was used for all runs Before the beginning of the experiment an information 
of the experiment. level from one to nine (II,. ■ ■ ,19) was randomly assigned 

to each trader which he/she kept for the whole session. 
2.2 Information setup There was one trader for each information level and this 

was public knowledge. At the beginning of each period 



To value the shares, traders on the market got informa- 
tion about future dividends. The idea of Hellwig [6] was 
extended to nine information levels: different levels of in- 
formation correspond to different lengths of windows in 
which one can predict future dividends. Trader II knows 

the dividend for the end of the current period, trader 12 The main interest is in how information affects the per 



new information was delivered to the traders depending 
on their level of information. 

2.3 Results of the Experiments 



knows the dividends for the current and the next period, formance of traders. The net return of traders compared 
. . . , trader 19 for the current and the next eight periods to the market return as a function of the information 
|ll|12j . This way we got a cumulative information struc- level can be seen in Fig. [TJ the results are the average 
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Fig. 1. Results of experiments (average of seven experiments). 
Return of traders relative to the market in percentage, as a 
function of the information. The returns are a non-monotonic 
function of information. 

of the seven experiments. One can verify that the returns 
do not grow monotonically with increasing information. 
Traders having the first five levels of information do not 
outperform the average and only the best informed traders 
(insiders) are able to gain excess returns compared to 
the market [11112] . For a statistical comparison of per- 
formance of traders we ran the Wilcoxon rank sum test 
for equal medians [13114] . on the relative performance for 
pairs of information levels. The p-values of the tests can be 
found in Table Q] Though in many of the cases the result 
of the test does not exclude the hypothesis of the returns 
being drawn from the same population, one can see that 
only the very well informed traders (18 and 19) perform 
significantly better than 13 and 15 on the 0.05 significance 
level, and the averagely informed (15) underperform the 
least informed (II) at the 0.1 significance level. 

Since all information in the experiment is provided for 
free and is always correct, the result can not be due to in- 
formation cost or wrong information. Furthermore, imple- 



Table 1. p-values of the Wilcoxon rank sum test for equal 
medians on differences in performance between the information 
levels. * significant at the 0.05 level ** significant at the 0.1 
level 
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mcnting an information cost in the system would possibly 
enlarge the disadvantage of being averagely informed: it 
would decrease returns for average and high information 
levels most. 

A tool for corroborating the relevance of results in ar- 
tificial markets to the real-world is analysing from the 
point of view of some of the well known empirical styl- 
ized facts of markets [T3] . While not getting stylized facts 
in a simulation can falsify the assumptions made, of course 
these facts in themselves do not confirm other results of 
the simulation. The probability density function of price 
changes, the decay of the autocorrelation function of price 
changes and the decay of the autocorrelation function of 
absolute price changes were analysed in the experimental 
results. For the three tests the results showed similar re- 
sults as data from real markets: the distribution of returns 
was fat tailed, the autocorrelation of returns decayed fast 



Bence Toth, Enrico Scalas, Jiirgen Huber, Michael Kirchler 

and the autocorrelation of absolute returns decayed slowly 
(volatility clustering) [10] . 

3 The simulations 

We carried out computer simulations to numerically re- 
produce the results of the experiments done with human 
beings. The simulations were run using MATLAB® pro- 
gramming language. 

3.1 The market mechanism 

In our simulation we programmed an essential double auc- 
tion trading mechanism as it appears on most of real world 
financial markets, with a book containing the bid and ask 
orders. Since, in contrary to real world experiments, in 
a numerical simulation one has the possibility to analyse 
truly random traders, we implemented ten agents with dif- 
ferent levels of information going from zero-information 
(random traders), 10 to 19, and with the possibility of 
using different trading strategies as will be discussed in 
details in Section 13.21 and Section 13.31 In order to be able 
to estimate the error of our results we carried out 10000 
runs in each simulation (100 sessions of 100 runs). 
The simulation setup was very similar to the one in the 
experiments: the market contained a risky asset (stock) 
and a risk free bond (cash). Before beginning the simula- 
tion an information level was assigned to each of the ten 
agents (nine informed and one uninformed), thus having 
one agent for every level. Initially all agents were endowed 
with 1600 units of cash and 40 shares of stock with ini- 
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tial value of 40 units each. Trading consisted of 30 peri- 
ods each lasting 100 simulation steps. At the beginning of 
each period new information was delivered to the agents 
according to their information level as we will discuss in 
Section 13.21 At the end of each period a risk free interest 
rate was paid on the cash held by the agents, dividends 
were paid on the shares held by the agents (the risk free 
interest rate was r/ = 0.01, the risk adjusted interest rate 
r e = 0.05) and the book was cleared. We also carried out 
simulations without clearing the book and found that the 
clearing process does not make much difference in the re- 
sults. 

The dividend process (being the source of future informa- 
tion) was determined before the beginning of the trading. 
Similarly to the experiments, the dividend process was a 
random walk of Gaussian steps: 

D(t) = D(i - 1) + 0.1iV(0, 1). (3) 

with D(Q) = 0.2, where N(0,1) is a normal distribution 
with zero mean and unit variance (in case of D(i) < 0, we 
took |_D(£)|). We are carrying out finite time simulations, 
so that short trends in the random walk can have impor- 
tant effects on the dividend process and by that on the 
information structure and the price formation on the mar- 
ket. When studying the performance of heterogeneously 
informed agents we carried out measurements with differ- 
ent dividend processes. The results shown are the statistics 
of 100 simulation sessions, each being run with a different 
random dividend process. One session consists of 100 sim- 
ulation runs carried out with the same dividend process. 
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3.2 Information order placing mechanisms can be found on the web page: 

http: //www. phy.bme.hu/ "bence 

Overall we implemented ten levels of information, a com- 
pletely uninformed trader (random trader), 10 and nine 3.3.1 Fundamentalists 
informed traders with different levels of information from 
II to 19, where agent Ij has information of the dividends 
for the end of the current period and of (J — 1) forthcoming 
periods (forecasting ability). The information received by 
traders was the present value of the stock conditional on 
the basis of their forecasting ability. This was determined 
by Gordon's formula (Eq. \2§- 



Fundamentalist traders strictly believe in the information 
they receive. If they find an ask order with a price lower 
or a bid order with a price higher than their estimated 
present value, i.e. E{V\Ij,k), they accept the limit order, 
otherwise they put a new limit order between the former 
best bid and best ask prices. 



3.3 Trading strategies 



3.3.2 Random traders 

Random traders put orders randomly. With probability 
0.5 they put an ask (bid) order slightly higher (lower) 



At the beginning of each period agents submit orders ac- 
cording to their idea of the value of stocks. After that, than the current price, 
during the period, in every second, one trader is chosen 
randomly who either accepts a limit order from the book 4 Results 
(gives a market order) or puts a new limit order to the 
book. 

Since we do not have exact information on how traders 
use their information in real world and in the experiments, 
we gave the possibility to simulated traders to strictly 
apply the fundamental information they get (fundamen- 
talists), not to take any information in account except 
the current price, i.e. trade randomly (random traders) 

or to look at other pieces of information such as trends The final return relative to that of the whole market can 
(chartists). In this paper we show results for the case of be seen in Fig. ® the results are the average of 100 ses- 
fundamentalist and random traders, these strategies are sions, each session consisting of 100 runs. The results are 
described below. The details of the trading strategies and in good accordance with the experimental results: we get 



In our simulations we focused on the effect of information 
on the performance of agents throughout the market ses- 
sion. We also analysed the results from the point of view 
of stylized facts of stock markets. In order to reduce sta- 
tistical errors we carried out 10000 runs of the simulation. 

4.1 Final wealth as a function of information 
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Fig. 2. Results of simulations (average of 10000 runs). Returns 
of traders relative to the market in percentage, as a function 
of information. One can see that having average level of infor- 
mation is not necessarily an advantage. 



Table 2. p-values of the Wilcoxon rank sum test for equal 
medians on differences in performance between the information 
levels. * significant at the 0.05 level ** significant at the 0.1 
level 
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a curve we call J-curve. The agents having average level 
of information (11-15) perform worse than the completely 
uninformed random agent (10). The best informed agents 
outperform the market. (Besides common sense, the latter 
can be justified also using mathematics, since compared to 
the market index the simulation is a zero sum game. If the 
non-informed gets more or less the market return and the 
averagely informed are losers, then the well-informed must 
get excess gain.). To test the hypothesis of the J-curve we 
ran the Wilcoxon rank sum test for equal medians [13114] , 
on the relative performance for pairs of information lev- 
els. The p-values of the tests can be found in Table [H 
One can see that the hypothesis of returns for different 
information levels being drawn from the same population 
can be excluded in almost all cases at the 0.05 significance 
level. This result and its relevance to real markets will be 
discussed further in Section [5] 



To understand why the random trader gets almost ex- 
actly the market return and to see how the relative wealth 
of agents looks like for simpler cases, we ran simulations 
with only three agents in the market (in this case with the 
standard deviation of dividends being 0.01, r/ = 0.001 and 
r e = 0.005): an uninformed (10), an averagely informed 
(14) and a well informed (19). Fig. [3] shows the plot for 
this case similarly to Fig. [5] We can exclude the mono- 
tonicity of the curve and even if with three points it is 
harder to call it a J-curve, we can see that the random 
trader performs better than the average informed one and 
only the well-informed gets excess returns. In this case 
also the random trader performs under the market level, 
giving an explanation for the question raised: in case of 
enough actors present on the market, the price impact of 
the random trader becomes negligible, thus the random 
trader has equal probability of being beaten by the mar- 
ket and of beating the market. To have more insight into 
this process, in Table [3] we show the relative performance 
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Fig. 3. Results of simulations (average of 100 runs). Returns 
of traders relative to the market in percentage, as a function of 
information. Already, in case of 3 agents one can identify the 
J-curve. 

Table 3. Relative performance of the random trader on mar- 
kets with different number of agents. Note that in this case 
always the least informed are present on the market (e.g. in 
case of 3 traders: 10, II and 12). As more agents are present on 
the market, the performance of the random agent approaches 
market return. 

number of traders 3 5 7 9 10 
relative performance 

of random trader [%] -2.7 -1.0 -0.2 +0.2 -0.1 



of the random trader in case of different number of agents 
(when always the least informed agents are present on 
market). 

4.2 Stylized facts 

We analysed the results of our simulations from the point 
of view of the three common empirical stylized facts as 
were done for the experiments [10]. Fig [4] shows the auto- 
correlation functions of returns (circles and lines) and of 
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Fig. 4. Autocorrelation functions of returns (circles and lines) 
and absolute returns (dots and lines) and the noise level (solid 
lines). Autocorrelation of returns decays fast under the noise 
level while autocorrelation of absolute returns decays very 
slowly, showing the clustering of volatility. Results of one sep- 
arate run of the simulations. 

absolute returns (dots and lines). The noise level of the 
computations is also included in the plot (straight lines). 
One can see that the autocorrelation of returns decays 
fast under the noise level (with a negative overshoot for 
small lags as it is usual in real world markets too), thus 
there is no long time correlation in price changes. On the 
other hand the autocorrelation of absolute returns decays 
slowly showing the fact that big price changes tend to clus- 
ter (volatility clustering). (A slight even-odd oscillation is 
visible in the autocorrelation of absolute returns, this is 
an artifact of our simulation process, as there are many 
cases in which the intertrade time is two simulation steps, 
resulting in this oscillation.) 

For comparison, in Table [4] we have reported the first 
four moments of the log-return distribution for tick-by- 
tick General Electric (GE) prices in October 1999 (55559 
data points). In Figure [5j for these data, the autocorre- 
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Table 4. The first four moments of the logarithmic return 
distribution for tick-by-tick General Electric (GE) prices and 
for the simulated prices. 
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Fig. 5. Autocorrelation functions of returns (circles and lines) 
and absolute returns (dots and lines) and the noise level (solid 
lines) for the logarithmic returns of General Electric. Autocor- 
relation of returns decays much faster than that of the absolute 
returns, in agreement with the simulation results. 

lation of signed and absolute log-returns is plotted as in 
Figured! From Table[3]it can be seen that the distribution 
function of absolute returns in the simulation is leptokur- 
tic, similarly to real world data, even if the kurtosis is 
lower. Running the Jarque-Bera test, for goodness-of-fit 
to a normal distribution [16j . we can rule out the nor- 
mality of the distribution of the absolute returns for both 
cases. 



When testing for the stylized facts, we also studied 
markets with only random agents trading and we found 
similar stylized facts; thus we can state that these empir- 
ical facts are effects mainly due to the continuous double 
auction trading mechanism as it has been mentioned be- 
fore in Ref. J7] . 

5 Conclusions 

In this paper we presented a model of an experimental and 
a simulated double auction stock market with cumulative 
information delivered to traders. We focused on the value 
of information for the traders, in case of several informa- 
tion levels. 

The results of the experiments and the simulation show 
a non trivial, non monotonic dependence of agents' re- 
turns on the amount of information possessed. We found, 
that averagely informed traders perform worse than the 
market level. In the simulations we analysed the case of 
non informed traders and found that if there are enough 
traders present on the market, the non informed, random 
trader is able to get the market return. Hence we can 
state that averagely informed traders perform worse than 
the completely non informed, thus in case of the averagely 
informed traders the information has a negative effect on 
the performance. Only the most informed traders (insid- 
ers) are able to gain above-average returns. 

These results can give a possible explanation for a puz- 
zling real life phenomenon. Most of the professional fund 
managers on stock markets perform worse on the long 
run than the market itself, i.e. they get lower returns than 
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